What is claimed is: 



1. An object activity modeling method comprising the/^teps 



of: 

(a) obtaining an optical flow vector from a video sequence; 

(b) obtaining the probability distribution of the feature vector for 
a plurality of video frames, using the optical flow vector; 

(c) modeling states, using the probajafflity distribution of the 
feature vector; and 

(d) expressing the activity of th^ object in the video sequence 
based on state transition. 



2. The object activity modeling method of claim 1, wherein 
the step (a) is based on affine motion estimation. 

3. The object activity modeling method of claim 2, wherein 
the step (a) furthar comprises the sub-steps of: 

(a-1) grouping input video frames into a plurality of video frame 
groups and dividing each video frame group as an individual state; 

(a-/) obtaining an affine motion parameter for each video in the 
video frame group of each individual state; and 

(a-3) obtaining an optical flow vector from the affine motion 
imeters. 
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4. The object activity modeling method of claim 3, wherein 
the step (a-2) comprises a step for determining parameter^ which 
minimizes summed square difference ^(I t (x)-I H (xvv(x))) 2 over a 

given video based on the intensity of the pixel onytne object, which is 
expressed as l t (x)=l t -i(x-V(x)) when I denotes iprensity, t denotes time, 
x denotes a pixel location (x, y), and v denotes the motion vector, as 
motion parameters. / 

5. The object activity modeling method of claim 1, wherein 
the step (b) comprises a step for calculating probability distribution 
P(Z|Q) by the following equation: 

/ exp(- i (z - m) T )Q" 1 (Z - m)) 

P (#^) = TTi 

T (27T) N |Q| 1/2 

whereinyP=(pi,p 2 , ... Pa) denotes a motion vector calculated at 
each pixel location (x, y), L denotes the number of pixels in a video 
frame ox h region of interest, d denotes the number of dimensions, 
feature' vector Z, which is a d x L dimension vector, is 
Z = fc; 5 pf v .., Pl L ? p 1 2?P ^... ? p 2 L ,p^p^...p^) T , m is the mean vector of 
feature vector Z, and Q is the covariance matrix of feature vector Z, 
and it is assumed that feature vector Z is provided from observation 
/class Q. 
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6. The object activity modeling method of claim 1, wherein 
the step (b) further comprises the steps of: 

decomposing covariance matrix Q as the following eqi^tion: 

Q=<D AO T 

Wherein Z is equal to Z-m, the columns of Oyare orthonormal 
eigenvectors of covariance matrix Q, and A corresponds to the 
diagonal eigenvalue; and 

calculating probability distribution P#2|Q) by the following 
equation: 



P(Z|Q)= 



ex P(" 2?^ 2/l 



{2n) M \h\ 



1/2/ 



1 



(2*P) 



wherein M is the nurcfber of principal components, y { is the i-th 
component of Y, a\ is the i-th eigenvalue of Q, and p is the optimal 

/ 1 N 

value, which is obtair?(ed by p = Yo^ , and it is assumed that 

7 N-M 

feature vector Z is/jxovided from observation class Q. 

7. Tl/e object activity modeling method of claim 1, wherein 
in the step (o), the object activity in the video sequence is expressed 
using a Hidden Markov Model (HMM), based on state transition. 
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8. The object activity modeling method of claim 7, wherein 
the Hidden Markov Model (HMM) is expressed as A={2, A, B, n}/when 
N is the number of possible states, E satisfies S = {q-i, q2, v /ql}» A is 
{ay}, the transition between hidden states i and j, B /$ {bj(.)}, the 
observation symbol probability corresponding to stated j, and n is the 
initial state distribution, and the state S = {qi, q2vA, qN> and the initial 
state distribution n are determined in advance/oased on video data. 



9. An object activity recogryfion method comprising the 
steps of: 

(a) obtaining feature vectors by motion estimation for video 
frames; 

(b) determining a sta^6, to which each frame belongs, using the 
obtained feature vectorsyand 

(c) determining an activity model, which maximizes the 
probability between activity models and a video frame provided from a 
given activity Vmodel dictionary using a transition matrix for the 
determined/state, as the recognized activity. 

The object activity recognition method of claim 9, wherein 
the step (d) comprises a step of finding an activity model, which 
maximizes probability P(0|A,) from the given activity model dictionary 
{W ^-e}» when T is a positive integer indicating the number of 
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frames forming the video sequence, Z 1f Z 2 , .... Z T are feature vectors 
first frame, second frame, T-th frame, respertiveiyr-an^ if video 
frame 0={Zi, Z 2 , Z T } is given and E is foelTumber of state models. 

11. The object activity recognition method of claim 10, 
wherein the transition rp^trix is obtained by using an expectation- 
maximization (EMf algorithm based on the observation symbol 
probability tejtO} corresponding to scene j in the training process. 
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